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(54) DATA PROCESSING APPARATUS 



(57) The present invention relates to data process- 
ing apparatuses whteh improve the quality of decoded 
data, such as an image and sound, more. A decoding 
section 21 decodes, for example, encoded data ob- 
tained by JPEG-encodIng an Image, and an encoding 
section 22 encodes first decoded data obtained as a re- 
sult to output re-encoded data. Further, a decoding sec- 
tion 23 decodes the re-encoded data to obtain second 
decoded data. A class-classification adaptive process- 



ing circuit 24 generates a prediction tap used tor a pre- 
determined prediction calculation with tap coefficients 
obtained by learning, from the first decoded data and 
the second decoded data, and perfomns the predeter- 
mined prediction calculation by using the prediction tap 
and the tap coefficients to obtain a predk:tion value cor- 
reqDondIng to master data used as a master In the learn- 
ing. The present Invention can be applied to transfer 
systems for encoding Images and sound to transfer 
them. 
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Description 

Technical Reld 

[0001] The present invention relates to data processing apparatuses, and more partlcufarty, to a data processing 
apparatus which allows, for example, a hlgh-<|uallty Image and a high-quality sound to be decoded. 

Background Art 

[0002] The preeent applicant has already propoeed class classif ballon adaptive proceesing as a method for Improv- 
ing the quality of images and that of sound. 

[0003] The class classification adaptive processing Is fomied of dass dassiricatlon processing and adaptive process- 
ing. Data Is dasstfled into classes according to Its nature in the class dassfflcatlon processing, and the adapth^e 
processing Is applied to each dass. The adapove processing Is performed in the following way. 
[0004] Specifically, for example, assuming now that Images are to be handled, In the adaptive processing, for ex- 
ample, pixel valuee of a tow-quality image are linearly coupled with predetemnlned tap coefficientB to obtain piedlction 
values of pixel values of a high-quality Image, so that the low-quallty image is converted to the high-quality knage. 
[0005] More speclflcaJly, tor example. It is assumed now that a high-quality Image Is set to master data; a decoded 
imago having a reduced Image quafrty. obtained by encoding the high-quality image, for example, by a JPEG (Joint 
Photographic Experts Group) method or an MPEG (l\flovlng Picture Experts Group) method, and then decoding en- 
coded data. Is set to apprentice date^* and a prediction value E[y] of a hlgh-qualfty pixel value Y" sending as maser 

data, is obtained by a linear coupling model defined by linear coupling of a set of low-quality pixel values, x, , Xj 

senrlng as apprentice data, and predetermined tap coeffldents w^, w^* .... In this case, the predlcdon value Efy] can 
be expressed by the following expression. 



E|y]] = w^x, +W2X2 + . 



<1) 



30 



[0006] To generaiize expression (1 ), when a matrix "W f onmed of a set of tap coefficients "wj," a matrix "X" fomried 
of a set of apprentice data "X| " and a matrix "Y" formed of a set of prediction values E[yp are defined In the following 
expressions, 



[Expression 1] 
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the following observation equation is satisfied. 



55 XW = Y' (2) 

where, an element Xjj In the matrbc X Indicates J-th apprertice data in i-th set (set of apprentice data used for prediding 
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l-th master data yd of apprentice data, an element Wj in the matrix W Indicates a tap coefficient to be multiplied by the 
|-th apprentice data In a set of apprentice data, and yi Indicates l-th master data. Therefore, E[y|] Indicates a prediction 
value for the l-th master data. In expression (1), the suffbc I In the element yi of the matrix Y Is omitted to show y at the 
left-hand side, and the suffix I in the element x,j of the matrix X Is also omitted to show x^, X2, ... at the right-hand elde. 
5 [0007] It Is assumed that the least squares method Is applied to this observation equation (2) to obtain a prediction 
value E[y] close to the high-quality pixel value y." In this case, when a matrix "Y" tonned of a set of the pixel values 
Y serving as master data, and a matrix "E" tonned of a set of the remainders "e' of the prediction values E[y| with 
respect to the pixel values Y* defined in the following way, 

10 

[Expression 2] 



20 

the following remainder equation Is satisfied from expression (2). 

XW=Y+E (3) 

25 

[0008] in this case, tap coefficients W| used to obtain a prediction value E[y] dose to the original pixel value V are 
obtained when the following square error Is made minimum. 



30 [Bxpxesslon 3] 

35 

[0009] Therefore, when the result obtained by differentiating the above square en^r by the prediction coefficients Wj 
Is zero, In other words, the prediction coefficients Wj which satisfy the followtng expression are the most appropriate 
values for obtaining a prediction value Ely] dose to the pixel value "y-" 

40 

[Expression 4] 

45 

[G010] When expression (3) Is differentiated by the prediction coeffidents Wj, the following expression is satisfied. 

[Expression S] 

5^f; = x„.3— ; = x«.....5^ = x„(l = l^.....l) (5) 
[001 1 ] From expressions (4) and (5), expression (6) is obtained. 

55 
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[Expression 6] 



If I 



(6) 



[0012] In addition, when the relationships annong the apprentice data "x^,** the tap coefficients "Wj," the master data 
Vii' and the remainders "ei" In the remainder equations (3) are taken Into account, the following nonmal equations are 
^0 obtained from expreeelon (6). 



[Expression 7} 



is 
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[0013] When a matrix (covarlance matrix) A and a vector V are denned In the following way. 



so 
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so 



[Expression 8] 
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and the vector W Is defined as shown In expression (1), the nomnal equations shown In (7) can be expressed In the 
following way. 

AW=v (8) 
[0014] The same number of normal equations [7} as that 'J" of the tap coefficients "Wj' to be obtained can be for- 
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muiated IT a certain number of sets ol apprentice data and master data Vi are prepared. Therefore, by solving equation 
(8) tor the vector W (to solve equation (8). the matrix A In equation (8) needs to be a non>slngular matrix), the tap 
coefficients 'Nvj" which make a statistical prediction ennor minimum (in this case, which make the square error minimum} 
Is obtained. It is possible to use, for example, a sweep off method (Gauss-Jordan deletion method) to solve equation (8). 
5 [0015] As described above, In the adaptive processing, the tap coefficients Wj which make the statistical prediction 
error minimum are obtained, and then, a prediction value E[y] close to the high-quallty pixel value "y** Is obtained from 
expression (1 ) by the use of the tap coefticients Wj. 

[0016] When an mage having the same Image quality as the Image to be encoded Is used as master data, and a 
decoded Image obtained by first encoding the master data and then decoding It Is used as apprentice data, for example, 
10 tap coefficients which make the statistical prediction error minimum In a process of decoding the encoded Image data 
to generate the original Image data are obtained. 

[0017] When an image having a higher resolutton than the Image to be encoded is used as master data, and a 
decoded Image obtained by reducing the resolution of the master data to the same Image quality as the Image to be 
encoded, encoding it, and then decodihg it is used as apprentk^e data, for example, tap coetriclents whk:h make the 
statistical prediction error minimum In a process of decoding the encoded Image data to generate the high-resolutlon 
image data are obtained. 

[0018] Therefore, In this case, according to the adaptive processing, dspending on selecting an Image used for 
master data or apprentice data, tap coefficients are obtained which can adjust the image quality of a decoded Image 
as desired. 

20 [001 9] The adaptive processing largely differs from usual filtering Implemented by a filter in that tap coefficients whteh 
make the statistical prediction en-or minimum by learning are used, and a high-frequency component not Included In 
the Image to be encoded is reproduced. 

[0020] Therefore, when class clessiflcation adaptive processing Is applied to a decodefd Inage obtained by decoding 
encoded data, the decoded image has an Improved Image quality. 
ss [0021 ] if the image quairty of a decoded image obtained by decoding encoded data is very low due to, for example, 
the state of a transmission path through which the encoded data Is transmitted, and a compression rate at which Image 
data was encoded, however, even when class classification adapth^e pnscessing Is executed only by the use of the 
decoded Image, it Is difficult to sufficiently Improve Its Image quality in some cases. 

30 Disclosure of invention 

[0022] The present Invention has been nr\ade In conskJeratlon of the above situation. An object of the present Invention 
Is to allow data having a suffldentiy Improved quality to be obtained. 

[0023] A first data processing apparatus according to the present Invention is characterized by Including decoding 
3s means for decoding encoded data and for outputting decoded data; re-encodIng means for encoding the decoded data 
and for outputting re-encoded data; prediction-tap generation means for generating a prediction tap used for a prede- 
temnined prediction calculation with tap coefficients obtained by learning, from the decoded data and information ob- 
tained from the re-encoded data; and prediction means for obtaining a predicUon value corresponding to master data 
used as a master In the ieaming, by the predetenmlned prediction calculation with the use of the prediction tap and the 
40 tap coefficients. 

[0024] A first data processing method according to the present invention Is characterized by including a decoding 
step of decoding encoded data and of outputting decoded data; a re-encodlngstep of encoding the decoded data and 
of outputting re-encoded data; a prediction-tap generation step of geneFBting a prediction tap used for a predetemnined 
prediction calculation with tap coefficients obtained by learning, from the decoded data and Infomnatlon obtained n^om 
the re-encoded data; and a prediction step of obtaining a predk:tlon value conesponding to master data used as a 
master In the ieaming, by the predetennlned prediction calculation with the use of the prediction tap and the tap coef- 
ficients. 

[0025] A first program acconiing to the present Invention is characterized by Including a decoding step of decoding 
encoded data and of outputting decoded data; a re-encoding step of encoding the decoded date and of outputting re- 

so encoded data; a prediction-tap generation step of generating a prediction tap used for a predetermined prediction 
calculation with tap coeffteients obtained by ieaming, from the decoded data and infomnatlon obtained from the re- 
encoded data; and a prediction step of obtaining a prediction value corresponding to master data used as a master In 
the learning, by the predetemnined prediction calculation with the use of the prediction tap and the tap coefficients. 
[0026] A first recording medium according to the present Invention Is characterized by recording a program, the 

55 program including a decoding step of decoding encoded data and of outputting decoded data; a re-encodIng step of 
encoding the decoded data and of outputting re-encoded data; a prediction-tap generation step of generating a pre- 
diction tap used for a predetemilned prediction cateulation with tap coefficients obtained by learning, from the decoded 
data and Infom^tion obtained from the re-encoded data; and a prediction step of obtaining a prediction value corre- 
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spending to master data used as a master In the learning, by the predetemnlned prediction calculation with the use ot 
the prediction tap and the tap coefficients. 

[0027] A second data processing apparatus according to the present Invention Is characterized by Including appren- 
tbe-data generation means for generating from master data sen/Ing as a master, decoded data obtained by encoding 

s the master data and then decoding it, and Information obtained from re-encoded data obtained by encoding the decoded 
data, as apprentice data serving as an apprentice; prediction-tap generation means for generating a prediction tap 
used for predicting the master data, from the apprentice data; and leaming means for perronning learning such that 
the prediction en-or of a prediction value for the master data, obtained by perfomiing a predetemrilned prediction cal- 
culation by using the predlcdon tap and tap coefficients, Is statistically nnlnlnuim, and for obtaining the tap coefficients. 

10 [0028] A second data processing method according to the present Invention characterized by including an apprentice- 
data generation step of generating from master data serving as a master, decoded data obtained by encoding the 
master data and then decoding It. and infontiatlon obtained from re-encoded data obtained by encoding the decoded 
data, as apprentice data serving as an apprentice; a predlctlon-tap generation step of generating a prediction tap used 
for predicting the master data, trom the apprentice data; and a leaming step of performing learning such that the 

1^ prediction enor of a prediction value for the master data, obtained by a predetemiined prediction calculation by using 
the prediction tap and tap ooefficients, Is statistically minimum, and of obtaining the tap coefficients. 
[0029] A second program according to the present invention is characterized by including an apprentice-data gen- 
eration step of generating from master data sen/ing as a master, decoded data obtained by encoding the master data 
and then decoding it, and information obtained from re-encoded data obtained by encoding the decoded data, as 

20 apprentice data senrtng as an apprentice; a prediction-tap generation step or generating a prediction tap used for 
predicting the master data, from the apprentice data; and a leaming step of perfbrming leaming such that the prediction 
errorof a prediction value for the master data, obtained by a predetermined prediction calculation by using the prediction 
tap and tap coefficients, Is statlstlcalty minimum, and of obtaining the tap coeffbients. 

[0030] A second recording medium is characterized by recording a program, the program Including an apprentlce- 

S5 data generation step of generating from master data serving as a master, decoded data obtained by encoding the 
master data and then decoding it. and Infonnatlon obtained from re-encoded data obtained by encoding the decoded 
data, as apprentice data serving as an apprentice; a predlctlon-tap generation step of generating a predlcdon tap used 
for predicting the master data, from the apprentice data; and a leaming step of performing leaming such that the 
prediction enx>r of a pradlctlon value for the master data, obtained by a predetemiined prediction calculation by using 

^ the prediction tap and tap ooefTlclents, is statistically minimum, and of obtaining the tap coefficients. 

[0031 ] A third data processing apparatus according to the present Invention Is characterized by including decoding 
means for decoding encoded data obtained by encoding data and tbr outputting decoded data; re-encodlng means for 
encoding the decoded data and for outputting re-encoded data; class-tap generation means for generating a class tap 
used for the class class Vicatlon, from the decoded data and Infonnadon obtained from the re-encoded data; and class 

^ dasslftcatfon means for perf omning class ciassiffcatlon according to the deas tap. 

[0032] A third data processing method according to the present Invention Is characterized by Including a decoding 
step of decoding encoded data obtained by encoding data and for outputting decoded data; a re-encoding step of 
encoding the decoded data and for outputting re-encoded data; a class-tap generation step of generating a class tap 
used for the dass classification, from the decoded data and infomiatlon obtained from the re-encoded data; and a 

^ class dassiflcatlon step of perfomnlng class dassificatlon according to the class tap. 

[0033] A third program according to the present invention Is characterized by including a decoding step of decoding 
encoded data obtained by encoding data and for outputting decoded data; a rs-encodlng step of encoding the decoded 
data and for outputting re-encoded data; a dass-tap genarab'Dn step of generating a dass tap used for the dass 
classification, from the decoded data and infonmadon obtained from the re-encoded data; and a class dassiflcatlon 

^ step of perfomnlng dass dassiflcaaon according to the class tap. 

[0O34] A third recording medium according to the present Invention is characterized by recording a program, the 
program Including a decoding step of decoding encoded data obtained by encoding data and for outputting decoded 
data; a re-encoding step of encoding the decoded data and for outputting re-encoded data; a class-tap generation step 
of generating a dass tap used for the class classification, from the decoded data and information obtained from the 

so re-encoded data; and a class ciassmcatlon step of perfonnlng dass classmcatlon according to the class tap. 

[0035] In the nnst data processing apparatus, the first data processing method, the first program, and the first record- 
ing medium according to the present Invention, encoded data Is decoded, and decoded data obtained as a result Is 
encoded to output re-encoded data. Aprediction tap usedfor a predetermined prediction calculation with tap coeffldentB 
obtained by leaming Is generated from the decoded data cuid Infbmnation obtained from the rs-encoded data. Hie 

S5 prediction tap and the tap coefficients are used to perform the predetermined prediction calculation to obtain a prediction 
value corresponding to master data used as a master in the leaming. 

[OOSa] In the second data processing apparatus, the second data processing method, the second program, and the 
second recording medium acconjing to the present Invention, decoded date obtained by encoding master date and 
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decoding tt. and Infonnatlon obtained from re-encoded data obtained by encoding the decoded data are generated 
from the master data serving as a master, as apprentice data serving as an apprentice. Then, a predlcOon tap used 
for predicting the master data Is generated from the apprentice data, and learning Is perfonned such that the prediction 
error of a prediction value for the master data, obtained by perfomnlng a predetermined prediction calculation by using 

5 the prediction tap and tap coetnclents to obtain the tap coefficients. 

[0037] In the third data processing apparatus, the third data processing method, the third program, and the third 
recording medium according to the present invention » encoded data obtained by encoding data is decoded, and de- 
coded data obtained as a result Is encoded to output re-encoded data. Then, a class tap used tor class classification 
is generated from the decoded data and infonnatlon obtained from the re-encoded data. Class ciassllicatlon Is per 

10 formed according to the class tap. 

Brief Description of the Drawings 

[0038] 

IS 

Fig. 1 1s a view showing an example structure of a data transfer system according to an embodiment of the prssent 
invention. 

Fig. 2 Is a biocic diagram showing an example structure of a decoder 2. 

Fig. 3 is a biocic diagram showing an example structure of a class-classification adaptive processing circuit 24. 
20 Fig. 4A to Fig. 4D are block dlagranr^ showing example stmctures of class classification sections 33 and 59, 

Fig. 5 Is a fiowch€Ut describing processing executed by the decoder 2. 

Fig. 6 Is a block diagram showing an example structure of a leamlrig apparatus according to an embodiment ot 
the present Invention. 

Fig. 7 is a flowchart describing processing executed by the learning apparatus. 
2S Fig. 8 is a block diagram showing a first example structure of an encoder 1 and encoding sections 22, 52, and 55. 

Fig. 9 is a block diagram showing a first example structure of decoding sections 21 . 23, 54. and 56. 
Fig. 10 is a block diagram showing a second example structure of the encoder 1 and the encoding sections 22,. 
52, and 55. 

Fig. 11 Is a block diagram showing a second example structure of the decoding sections 21 , 23, 54, and 56. 
30 Fig. 1 2 is a block diagram showing a third example st aicture of the encoder 1 and the encoding sections 22, 52, 

and 55. 

Fig. 1 3 Is a block diagram showing a third example structure of the decoding sections 21 . 23. 54. and 56. 
. Fig. 14 is a block diagram showing an example staicture of a computer according to an embodiment of the present 
Invention. 

3S 

Best Mode for Cany ing Out the invention 

[0039] Fig. 1 shows an example structure of a data transfer system according to ah embodiment of the present 

Invention. 

40 [0040] Data to betransferred Isinputto an encoder 1 . The encoder 1 encodes the inputdata accordlngto,forexample, 
a predetennlned encoding method to generate encoded data. The encoded data le recorded Into a recording medium 
3, such as a semiconductor memory, a magneto-optk^al disk, a magnetic disk, an optical disk, a magnetic tape, or a 
phase-change disk, or Is transferred through a transfer medium 4. such as a terrestrial wave, a sateUite line, a CATV 
(cable television) network, the Internet or a public line. 

^ [0041] A decoder 2 receives and decodes the encoded data sent through the recording medium 3 or a transfer, 
medium 4, and outputs decoded data obtained as a result. When the decoded data Is image data, for example, the 
Image data Is, for example, sent to and displayed on a display not shown. When the encoded data la audio data, for 
example, the audio data is, for example, sent to and output from a speaker not shown. 
[0042] Next. Fig. 2 shows an example structure of the decoder 2 shown in Rg. 1 . 

50 [0043] The encoded data is sent to a decoding section 21. The decoding section 21 decodes the encoded data 
according to, for example, a decoding method corresponding to the encoding method used in the encoder 1 , and sends 
decoded data obtained as a result to an encoding section 22 and to a dass-ciasslficatlon. adaptive processing circuit- 
24. The decoding section 21 also sends Information obtained in a process of decoding the encoded data to the class- 
classification adaptive processing circuit 24 as additional Infomnatlon. 

55 [0044] The encoding section 22 encodes (re-encodes) the decoded data sent from the decoding section 21 according 
to, for example, the same encoding method as that used in the encoder 1 shown in Fig. 1 to generate re-encoded data. 
The re-encoded data Is sent from the encoding section 22 to a decoding sectton 23. 

[0O45] The decoding section 23 decodes the re-encoded data sent from the encoding section 22 and sends decoded 
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data obtained as a result to the class-classmcatlon adaptive processing circuit 24, for example. In the same way as In 
the decoding section 21 . The decoding secdon 23 also sends intonnatlon obtained In a process of decoding the re- 
encoded data to the class-classlflcation adapth^e processing drcult 24 as additional Infonnatfon. 
[0046] iHereinafter» if necessary, the decoded data output from the decoding section 21 which performs first decoding 

s is called first decoded data, and the decoded data output from the decoding section 23 which performs second decoding 
Is caJled second decoded data. In the same way, hereinafter. If necessary, the additional Infonnatlon output from the 
decoding section21 which perfonns the first decoding Is called first additional Infomnatlon. and the additional I nfomnatlon 
output from the decoding section 23 which perfomrts the second decoding Is called second additional information. 
Further, hereinafter, if necessary, the first decoded data and the second decoded data are collectively called Just de- 

10 coded data. In the sanne way» hereinafter, if neceesaiy, the first additional Infonnatlon and the second additional Infor- 
mation are coliecdvely called Just additionaJ Infonnatlon. 

[0047] The class-classlflcatlon adaptive processing drcult 24 uses the first decoded data and the first additional 
Information sent trom the decoding sectbn 21 and further the second decoded data and the second additional infor- 
mation sent from the decoding section 23 to perform class-classlflcatlon adaptive processing, and outputs decoded 
data (hereinafter^ If necessary called final decoded data) serving as a final decoding result of the encoded data. 
[0O48] Therefore, since the class-classification adaptive processing circuit 24 usee the first decoded data obtained 
by decoding the encoded data, the first additional Infonnatlon obtained In tiiat decoding process, the second decoded 
data obtained by rie-encodlng the first decoded data and then decoding the re-encoded data, and the second additional 
infomnatton obtained in the process of decoding the re-encoded data to perform class-classification adaptive process- 
so ing, even If the first decoded data has largely reduced quality, It is possible to obtain the final decoded data having a 
sufnclemiy Improved quality. 

[0O49] One or more sets similar to the set of the encoding section 22 and the decoding section 23 can be provided 
In a subsequent stage of the decoding section 23. In this case, It is possible that third decoded data obtained by 
encoding the second decoded data and then decoding encoded data obtained as a result, and third additional Infor- 
S5 mation otjtained In that decoding process are sent to the class-dassification adaptive pnscessing drcult 24 to perform 
class-ciasstricatlon adaptive processing. 

[0O5O] Fig. 3 shows an example stmcture of the class-classification adaptive processing drcult 24 shown in Rg. 2. 
[0051 j The first decoded data, the first additional Infonnation, the second decoded data, and the second additlonat 
infomiation are Input to tap generation sections 31 and 32. 

30 [0052] The tap generation section 31 generates a prediction tap used for a prediction calculation executed in a 
prediction section 35, descrbed later* from the first decoded data, the first additional information, the second decoded 
data, and the second additional infonnatlon. More specifically, the tap generation section 31 extracts, for example, first 
ctecoded data and second decoded data that are closer In time or In space almed-at data which Is ahrted at because 
it Is to be Improved In quality, also extracts first additional Information and second additional Information used for 

^ decoding that first decoded data and that second decoded data, and then, sends extracted data Qnfomiation) to the 
prediction section 35 as a prediction tap. 

[0O53] The tap generation section 32 generates a dass tap used for dass classification executed In a dass dassi- 
ricatlon section 33. described later, from the first decoded data, the first additlonat Irtfomiatlon. the second decoded 
data, and the second additional information. More specifically, the tEip generation section 32 generates, for example, 
^ a dass tap having the same structure as the prediction tap generated by the tap generation section 31 for the aimed- 
at data, and sends it to the dass classification section 35. 

[0054] To make a description simple, It Is spedfled hers that tiie class tap have the same structure as the prediction 
tap. It is possible that the dass tap and the prediction tap hacve dHferent structures, more specifically^ they are generated 
by extracting different data Items from the first decoded data, the first acUltional infomnation, the second decoded data, 
^ and the second additional infonnatlon. 

[0055] The class dasslfloation section 33 perfbmns dass classification for the ainr»ed-at data according to the dass 
tap sent from the tap generation section 32, and outputs a class code corresponding to a dass obtained as a result to 
a coefficient memory 34. 

[0056] The coefHcient memory 34 stores tap coefficients for each dass. obtained by learning processing executed 
so In a learning apparatus shown in Rg. 6. descrbed later, and outputs the tap coefficients stored at the addrsss corre- 
sponding to the class code output Trorh the class dasslficatlon section 33, to the prediction section 35. 
[0057] The prediction section 35 obtains the prediction tap output from the tap generation section 31 and the tap 
coefndents output from the coeffident memory 34, uses the prediction tap and the tap coefficients to peifonn a linear 
prediction calculallon (sum-of-products calculation) Indicated by expression (1 ), and obtains and outputs data acquired 
ss by improving the quality of the avned-at data, that Is, a prediction value of the aimed-at data having higher quality. 
[0088] Next Fig. 4 shows an example structuns of the dass dassrflcation section 33 shown in Fig. 3. 
[0059] The dass ciasstfication section 33 can be fonDed, for example, of ADRC (adaptive dynamic range coding) 
circuits 41 A and 41 B, and a syndiesis dncuit 41 C, as shown in Rg. 4A. 
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[0060] In this case, the ADRC circuits 41 A and 41B apply K-bIt ADRC procdssing to decoded data and additional 
mroimatlcn which constitute the dass tap, and output ADRC codes obtained as results to the synthesis circuit 41 G. 
[0061] In the K-bIt ADRC processing, for example, the maximum value MAX and the minimum value MIN of the 
infomiatlon constituting the class tap are detected, the difference DR = MAX - MIN therebetween is set to a local 

5 dynamic range of a set. and the Information constituting the class tap Is re-quantteed to K bits according to this dynamic 
range DR. IN other words, tiie minimum value MIN Is subtracted from each Intomnatlon constituting the dass tap, and 
the remainder Is divided (quantized) by A bit string in which the K-bIt values, obtained as described above, ot 

the Infomnation constituting the class tap are arranged in a predetemilned order Is output as an ADRC code. 
[0062] The synthesis circuit 41 C ^ntheslzes the ADRC code of the decoded data, output from the ADRC circuit 41 A 

to and the ADRC code of the additional Information, output from the ADRC circuit 41G Into one code and outputs It as a 
class code. 

[0063] As described later, additional Information constituting a class tap Is not limited to one type. When there are a 
plurality of additional infomnation. the ADRC circuit 41 B applies the ADRC processing to each of the plurality or addi- 
tional Information, and outputs a plurality of ADRC codes. Then, the synthesis circuit 41 C generates one code from 
IS the plurality of ADRC codes. This can also be applied to the class classification section 33 shown In each of Fig. 4B 
to Fig. 4D, described later. 

[0064] Next, the class dasslflcatlon section 33 can also be fornied. for example, of calculators 42A and 428, and 
the ADRC circuits 41 A and 41 B and tiie synthesis cincult 41 C shown in Fig. 4A. 

[0065] More specifically, in this case, the calculator 42A calculates the difference between the first decoded data 
20 constituting the class tap and the second decoded data conrespondlng to the first decoded data, and sends the differ- 
ence to the ADRC dncult 41 A. The calculator 42B calculates the difference between the first additional information 
conatituting the class tap and the second additional Infonmation con^sponding to the first additional Information, and 
sends the difference to tiie ADRC circuit 41 B. 

[0066] The second decoded data corresponding to the first decoded data nneans, when the decoded data Is an 
S5 image, for example, the same decoded pixel obtajned as the second decoded data as the decoded pixel obtained as 
the first decoded data, in other words, when decoded pixels serving as first decoded data and second; decoded data 
at a position (x, y) in a frame f are called p1(f, x, y) and p2(f, x, y>, the second decoded data corresponding to the first 
decoded data pi (f, x. y) is p2(f, x, y). 

[0067] The second additional Information conrespondlng to the first additional information means, when tiie decoded 
so data is audio data decoded by a CELP (code excited linear prediction coding) method, described later, and the additional 
information is linear prediction coefficients obtained in that decoding process, the linear prediction coefficients obtained 
as the second additional Inromnatlon. having the same order as tiie linear prediction coetndents obtained as the first 
additional InfomiaUon. In ctherwords, when the p-th orderllnear prediction coefficients used for audio decoding, serving 
as first decoded data and second decoded data In a frame (or sub-frame) f are called a1 (f, p) and a2{f, p), the second, 
additional infomnation corresponding to the first additional Infonmation a1 (f , p) Is o(2(f , p). Further, when the decoded, 
data Is Image data decoded by a JPEG method, described later, and the additional Infonnatton Is DCT coefficients 
obtained in that decoding process, for example, the second additional information corresponding to the first additional 
Infomfiatlon means the DCT coefficients obtained as the second additional Information, having the same spatial fre- 
quency as the DCT coefficients obtained as ttie first additional Infonnatlon. In otiier words, when DCT coefficients 
^0 serving as first additional infomnation and second additional Infomiatlon at a position (x, y) In a elght-by-elght block b 
on a frame f are called d1(f, b, x, y) and d2(f, b, x, y), the second additional information corresponding to the first 
additional InfonDatlon d1 (f, b, x, y) Is d2(f , k), x, y). . ^ 

[0068] The same processing as in the case shown in. Fig. 4A is applied to the difference between the first decoded 
data and the second decoded data and to the difference between the first additional InToimation and the second ad- 

^ ditional Infonmation to obtain a class code. 

[0069] Further, the class classification ciicult 33 can also be configured, for exampfe, as shown In Fig. 4C. . 
[0070] Also In tills case. In the same way as In the case shown In Fig. 4B,thecalculator42A calculates the difference 
between the first decoded data and the second decoded data, and the calculator 42B calculates the difference between 
the first additional infonrtation and the second additional infomriBtion. 

so [0071 ] The difference between the first decoded data and tiie second decoded data Is sent from the calculator 42A 
to a polarity determination circuit 43C. The polarity determination circuit 43C detemilnes the polarity (sign) of the 
difference between the first decoded data and the second decocted data, and outputs "0" or "1 " according to the polarity 
to a synthesis clicult 43E. 

[0072] The difference between the first additional Infonmation and the second additional Infomnation Is sent from the 
ss calculator 42B to a polarity determlnatio n circuit 43D. The polarity detenriination circuit 43D determines the polarity of 
the difference between the first additional Information and the second additional information, and also outputs "O" or 
•1' according to the polarity to the synthesis circuit 43E. 

[0073] The synthesis circuit 43E synthesizes series of "0" or °1 " corresponding to the.polarlties, sent from ttie polarity 
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determination circuits 43C and 44C into one code and outputs it as a class code. 

[0074] Further, the class dasslMcatlon section 33 can also be rormed. as shown in Fig. 4D. of delay circuits 44A and 
44B and calculators 44C and 44D. and the ADRC drcu Its 41 A and 41 B and the synthesis circuit 41C shown In Rg. 4A. 
[0075] In this case; the delay circuit 44A delays the decoded data constituting the class tap, for example, for the 
5 period corresponding to one sample (one class tap), and sends It to the calculator 44C. The calculator 44C calculates 
the difference between the decoded data constituting the class tap and the delayed decoded data output from the 
delay circuit 44A. and sends the dilTerence to the ADRC circuit 41 A. 

[0076] The delay circuit 44B delays the additional Information constituting the class tap. tor eocampie, for the period 
corresponding to one sample (one ciass tap), and sends It to the caicuiator 44D. The calculator 440 calculates the 
10 dtlTerence between the additional Information constituting the ciass tap and the delayed additional Infonnatlon ou^Mit 
from the delay circuit 44B, and sends the difference to the ADRC circuit 41 B. 

[0077] Then , the ADRC circuits 41 A and 41 B and the synthesis circuit 41 C apply the same processing as In the case 
shown In Fig. 4A to the above-described dltrerences to output a class code. 

[0078] In addition, the dass classification section 33 can also be fonned, for example^ of a drcult for synthesizing 
f^ any two or more outputs of the circuits shown In Rg. 4A to Fig. 4D into one code and for outputting It. 

[0079] Further, the class classlflcallon section 33 can also be fomied of a drcu it other than the drcults shown In Fig. 
4. More speclflcaity, when DCT (discrete cosine transform) coeffidents, one type of orthogonal conversion coeffidents, 
are obtained in a process of decoding encoded data, such as JPEG-encoded data or MPEG-encoded data, and addl- 
tional Information constituting a dass tap Includes such DCT coeffidents. for exannpia, the class dassrfication sedion 
20 33 can be configured such that it outputs a class code based on the activity of an Image obtained from DOT coeffidents 
In a elght-by-elght block, or such that It outputs a dass code based on the position of an alned-at pixel In a block. 
Further, tiie class classification section 33 can also be configured, forexampie, such that It outputs the rseuit obtained 
when vector quantization Is applied to the decoded data or the additional Information constituting the class tap, as a 
class code. 

2S [0080] Processing (decoding processing) executed by the decoder 2 shown in Rg. 2 will be described next by refer- 
ring to a flowchart shown in Fig. 5. 

[0081] The decoding section 21 decodes the encoded data according to a decoding method con^espondlng to the 
encoding method used In the encoder 1 , and sends the first decoded data obtained as a result to the encoding eedion 
22 and to the dass-dasslficatlon adaptive processing drcult 24. The decoding section 21 also sends Infonnation ob- 

30 tatned in a process of decoding the encoded data to the class-dasslflcatlon adaptive processing drcult 24 as the first 
additional information. The encoding section 22 re-encodes the decoded data sent from the decoding section 21 , and 
sends re-encoded data obtained as a result to the deoocflng section 23. The decoding section 23 decodes the re- 
encoded data sent from the encoding section 22 and sends the second decoded d^ obtained as a result to the dass- 
classlf Ication adaptive processing drcult 24, In the same way as In the decoding section 21 . The decoding section 23 

38 also sends Information obtained In a process of decoding the re-encoded data to the dass-dasslflcaHon adaptive 
processing circuit 24 as the second additional Infonnation. 

[0082] In the dass-dassrf ication adaptive processing drcuit 24 (Rg. 3). in step SI. the tap generation sedion 31 
sequentially sets the first decoded data Input thereto to almed-at data, generates a prediction tap for the almed-at data, 
for example, from first decoded data closer in time or in space to the almed-at data, second decoded data closer In 

^ time or In space to the second decoded data corresponding to tiie almed-at data, the first additional infonnatlon obtained 
in the decoding process of the abned-at data, and the second additional Infonnation obtained In the decoding process 
of tiie second decoded data con-espondlng to the almed-at data, and outputs the prediction tap to the predledon section 
35. Also In step SI , the tap generation section 32 generates a dass tap for the aimed-at data, for example, in the same 
way as the tap generation section 31 , and outputs the dass tap to tiie class dassincation section 33. 

^ [0083] Then . the processing proceeds to step S2, stkI the class dassmcation section 33 perfomns dass dasslflcaUon 
according to tiie dass tap sent from the tap generation section 32, and sends a dass code obtained as a result to tiie 
coeffldent memory 34. Then, the processing proceeds to step S3. 

[0084] In step S3, the coefHdent memory 34 reads the tap coefficients at tiie address corresponding to the dass 
code sent from the class dassrfication section 33. and sands the tap coeffidents to the prediction section 35. 

so [0085] Then , the processing proceeds to step 84. and the prediction section 35 obtains the tap coemclents output 
from the coeffldent memory 34, and performs tiie sum-of-products calculation Indicated In expression (1 ) by using tiie 
tap coefficients and the prediction tap sent from the tap generation section 31 to obtain (a prediction value oQ data 
acquired by Improving the quality of the almed-at data. The processing proceeds to step S6. 
[0088] In step S5» It Is determined whether there still Is first decoded data to be processed as almed-at data. When 

ss it is determined that there is, the processing rstums to step SI f inst decoded data to be set to amed-at data next is set 
to new aimed-at data, and the same process^ are repeated. In step S5, when it is detemnlned that there Is not data 
to be processed as almed-at data, tiie processing Is terminated. 

[0087] Next, Fig. 6 shows an example structure of a learning apparatus for perfomnlng learning processing for tap 
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coefficients to be stored In the coefficient memory 34 shown In Fig. 3, according to an embodiment. 
[0086] For example, high-qualtty data corresponding to data to be encoded by the encoder 1 shown In Rg. 1 1s input 
to the learning apparatus as learning data. This learning data Is sent to an apprentice-data generation section 51 and 
to a nomnal-equatlon adder 60 as master data serving as a master In teaming. 
5 [0069] The apprentice-data generation secdon 51 generates apprentice data serving as an apprentice In leaning 
from the master data Input thereto. 

[0090] Specifically, the apprentice-data generation section 51 Is ^omied of an encoding section 52. a medium-char- 
acteristic reflection section 53, a decoding section 54, an encoding section 55, and a decoding section 56. 
[0091] The encoding section 52 encodes the master data In the same way as the encoder 1 shown In Fig. 1 , and 
10 sends encoded data obtained as a result to the medlunvcharacterlstlc reflection section 53. The medium -characteristic 
reflection section 53 adds (gives) noise and other attached to a signal when the signal passes through the recording 
medium 3 or the transfer medium 4 shown In Fig. 1 . to the encoded data sent from the encoding section 52. and sends 
the result to the decoding section 54. 

[0092] The decoding section 54, the encoding section 55, and the decoding section 58 have structures similar to 
r5 those of the decoding section 21 , the encoding section 22, and decoding section 23 In the decoder 2 shown . In Fig. 2, 
respectively. Therefore, the decoding section 54, the encoding section 55, and the decoding section 56 apply processing 
to encoded data output from the medium-characteristic reflection section 53, In similar manners to those of the decoding 
section 21 , the encoding section 22, and the decoding section 23 shown in Rg. 2, respecth/ely. As a result, the decoding 
section 54 outputs first decoded data and first additional information as apprentice data, and the decoding section 56 
20 outputs second decoded data and second additional infomiation as apprentice data. The first decoded data and the 
first additional Infomnatlon, and the second decoded data and. the second additional Infomiation sending as apprentice 
data are aent to tap generation sections 57 and 56. 

[0093] In the.decoder Z shown In Fig. 2, as described above, one or more sets similar to the set of the encoding 
section 22 and the decoding section 23 can be provided In a subsequent stage of the decoding section 23. In this case, 
25 In the apprentice-data generation section 51 in the learning apparatus shown in Fig. 6. in the same way as in the 
decoder 2, one or more sets similar to the set of the encoding section 55 and the decoding secdon 56 need to be 
provided in a subsequent stage of the decoding section 54. 

[0094] The tap generation section 57 is configured In the same way as the tap generation section 31 in the dass- 
classif Icatlon adaptive processing circuit 24 shown In Fig. 3. The tap generation section 57 generates a prediction tap 
30 from thef Irst decoded data and the first additional Infomnation, and the second decoded data and thesecond additional 
Information serving as apprentice data input thereto, in the same way as the tap generation section 31 . and sends the 
prediction tap to the nomial-equatlon adder 60. 

[0095] The tap generation section 58 Is configured in the same way as the tap generation section 32 in the class- 
vclassif Icatlon adaptive processing circuit 24 shown In Fig. 3. The tap generation section 58 generates a class tap from 
3s the first decoded data and the first additional infomiation, and the second decoded data and the second additional 
Infoffnatlon serving as apprentice data Input thereto, In the same way as the tap generaUon section 32, and sends the 

class tap to the class classification section 59. 

[0096] The class classification section 59 perfomis class classification according to the class tap sent from the tap 
generation section 58 In the same way as the class classification section 33 in the class-classification adaptive process- 
^0 ing circuit 24 shown In Fig. 3, and sends a class code obtained as a result to the nomnai-equation adder 60. 

[0097] The normal-equation adder 60 eequenllaiiy sets the master data input thereto to the aimed^at master data, 
and perfomns additions for the prediction tap generated for the almed-at master data, sent from the tap generation 
section 57. and for the aimed-at master data, in each dass indicated by the class code sent from the class classification 
section 59. 

45 [0096] Specifically, the nomoal-equatlon adder 60 uses the prediction tap (apprentice data) to perform calculations 
contending to multiplication (x^Xim) and summadon (I) between apprentice data, which produce the components 
of the matrix A in expression (6), for each class comespondlng to the dass code sent from the class classification 
section 59. 

[0099] The normal -equation adder 60 also uses the prediction tap (apprentice data) and the almed-at master data 
50 to perfomi calcuiailons con-espondlng to multiplication (x^i) and summation (Z) between the apprentice data and the 
almed-at master data, which produce the components of the vector v In expression (8). for each class con'esponding 
to the dass code sent from the class classification section 59. 

[0100] The normal-equation adder 60 perfonns the above-described additions for ail master data input thereto being 
set to almed-at master data, and generates the nonnat equation Indicated by expression (8) for each class. 
S5 [0101 ] A tap-coefficient determination drcuh 61 solves the equation generated for each class in the normal-equation 
adder 60 to obtain tap coefficients for each dass, and sends them as the address conresponding to each class in a 
coefficient memory 62. 

[0102] Depending on the amount or content of learning data, the number of normal equations required for obtaining 
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tap coefTlcIents cannot be obtained In the nomrmJ-equatlon adder 60 for a class In some cases. The tap-coemclent 
detemilnatlon circuit 61 outputs, for example, d^ult tap coeinclents for such a dass. 

[0103] The coefficient memory 62 stores tap coefficients for each dass. sent from the tap-co^clent determination 
circuit 61 . 

s [0104] Processing (learning processing executed by the learning apparatus shown In Rg. 6 will be described next 
by referring to a flowchart shown In Rg. 7. 

[0105] Learning data Is sent to the learning apparatus. This learning data Is Input to the apprentice-data generation 
section 51 and to the nonnal-equatlon adder 60 as master data. In step S11. the apprentlce-dma generation section 
51 generates apprentice data from the master data. 

10 [0106] Specifically, in step S1 1 » the encoding section 52 encodes the master data in the same way as the encoder 
1 shown in Rg. 1, and sends encoded data obtained as a result to the decoding section 54 through the medium- 
characteristic reflection section 53. The decoding section 54 decodes the encoded data input thereto, and sends first 
decoded data obtained as a result to the encoding section 55. and also as apprentice data to the tap generation sections 
57 and 58. The decoding section 54 also sends nrst additional Information obtained In a process for decoding tiie 

1^ encoded data to generate the first decoded data, to the tap generation sections 57 and 58 as apprentice data. 

[0107] Further, in step S1 1 , the encoding section 66 re-encodes the first decoded data sent from the decoding section 
54, and sends re>encoded data obtained as a result to the decoding section 56. The decoding section 56 decodes the 
re-encoded data sent from the encoding section 55, and sends second decoded data obtained as a result, and second 
additional information obtained In a process of decoding the reencoded data to generate the second decoding data. 

2o to the tap generation sections 57 and 58 as apprentice data. 

[0106] Then, the normal-equation adder 60 sets the master data Input thereto to almed-at master data, and the 
processing proceeds to step S1 2. The tap generation sections 57 and 58 generate a prediction tap and a class tap tor 
the almed-at master data from the apprentice data Input thereto. The prediction lap generated by the tap generation 
section 57 Is sent to the nonral-equaUon adder 61 , and tlie dass tap generated l>y the tap generation section 56 Is 

25 sent to the dass dassiticatfon section 59. 

[01 09] Then , the processing proceeds to step 813. and the class classification section 59 perfomis class ciassincatlon 
according to the class tap sent from the tap generation section 58, and sends a dass code obtained as a result to the 
nonnal-equation adder 60. The proceesing proceeds to step SI 4. 

[0110] In step S14, the normal>equation adder 60 applies the above-deecrlbed additions for the matrix A and the 
30 vector v in expression (6) to the almed-at master data input thereto and the apprentice data constituting the prediction 
tap sent from the tap generation section 57 in the class indicated by the class code sent from the class classification 
section 59. The processing proceeds to step SI 5. 

[01 1 1 ] in step SI 5, It Is detennlned whether there Is master data to be processed as almed-at master data. When n 
Is detenmlned that there Is, the processing returns to step S11 , and tiie same processes are repeated, for example, 
3s wttti master data sent next being set to new almed-at master data. 

[0112] When It Is detemnlned In step S15 that there Is no master data to be processed as almed-at nraster data, In 
other words, for example, the normal-equation adder 60 obtains a normal equation for each class, the processing 
proceeds to step S1 6. The tap-coefficient detemninatlon circuit 61 solves the normal equation generated for each class 
to obtained tap coefflcfents for each class, and sends and stores tiiem at the address comespondlng to the dass In 
the coefficient memory 62. Then, the processing Is terminated. 

[0113] As described above, tiie tap coefficients for each dass, stored In the coafUdent memory 62 is stored In the 
coeffldent memory 34 shown in Rg. 3. 

[0114] Therefore, since the tap coetfldents stored In the coefficient memory 34 shown In Rg. 3 are obtained by 
learning executed such that the prediction error (square en'or. In this case) of a prediction value of data having the 
^ same quality as teaming data, obtained when a linear prediction calculation is perfomied, becomes statistically mini- 
mum, the final decoded data output from the pre<flctlon section 35 shown In Fig. 3 has the same quality as the learning 
data. 

[0115] Next, Rg. 8 shows an example strudure of the encoder 1 shown in Fig. 1 used when the data transfer system 
shown in Fig. 1 encodes an audio signal (audb data) by a CELP (induding various types of CELPs such as VSELP 
so (vector sum excited liner prediction). PSi-CELP (pitch synchronous innovation CELP). and CS-ACELP (confugate 
structure algebraic CELP)) metiiod and transfers IL As described above, when ttie encoder 1 shown in Rg. 1 Is con- 
figured as shown in Fig. 6, tiie encoding section 22 shown in l=ig. 2 and the encoding sections 52 and 55 shown in Fig. 
6 are also configured as shown In Fig. 8. 

[01 16] An audio signal (Including that of voice and that of a musical piece) to be encoded is obtained, for example, 
S5 by sampling an analog audio signal at a sampling frequency of 8 kl-lz or the liice to AJD convert to a digital audio signal 
and furtherby quantizing at a predeteimined number of bits, and is sent to a calculator 71 and to an LPC (Oner prediction 
coemdem} analysis section 72. 

[0117] The LPC analysis section 72 applies LF^ analysis to the audio signal to be encoded, input ttiereto, for ex* 
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ampid. In units of frames each having 160 samples to obtain p-th linear prediction coefficients cx^ , 02 Op. Then, the 

LPC analysis section 72 sends a vector having the p-th linear prediction coefriclents Op (p = 1 , 2. .... P) as Its elements 
to a vector quantization section 73 as an audio feature vector. 

[0118] The vector quantization section 73 etores a code book In which code vectors having linear prediction coeffl- 
5 dents as their elements are associated with codes, applies vector quantization to the feature vector a sent from the 
LPC analysis section 72, and sends a code {hereinafter called an A code (Ajcode). If necessary) obtained as a result 
of vector quantization to a code detemni nation section 63. 

[01191 In addition, the vector quantization section 73 sends the linear prediction coefficients a^', 02' Op' serving 

as the elements of the code vector a* corresponding to the A code to an audio synthesis filter T4. 

10 [0120] The audio synthesis filter 74 is, for example, an lIR (infinite impulse response) type digital filter, and uses the 

linear prediction coefficients Op' (p 1 , 2 P) sent from the vector quantization section 73 as the tap coefficients of 

the IIR fitter and a remainder signal 3 sent from the calculator 82 as an Input signal to perfomn audio synthesis. 
[0121 ] More specmcaily, In the LPC analysis executed by the LPC analysis section 72. assuming that linear coupling 
indicated by the following expression Is satisfied for an audio signal (sample value) $„ at the cun-ent time n and past 

w P sample values s^^^, s^-a* adjacent thereto, 

^ when a prediction value (linear prediction value) s^' for the sample value s„ at the cunent time n is linearly predicted 
by the following expression with the use of past P sample values Sn.|, Sn.2, .... Sn^, 

«n' = -(<*l»n-l + («1«n-2 + + OCp^ivp) 

25 

linear prediction coefTicients ap which make the square enor between the actual sample value s^ and the linearly 
predicted value s„* minimum are to be obtained. 

[0122] In expression (9). {e^ (.... On.^, e„» e^.,, ...) Indicates random variables having an average of 0, a variance 
of a predetemntned value og. and no correlation with each other. 
30 [0123] From expression (9), the sample value Sp can be expressed by the following expression; 

8n = e„ - (a,8^^ + ogs^a + ... + aps^) (1 1) 

^ When Z transform Is applied to this expression, the following expression Is satisfied. 

S = E/(l + a^z'"' + ttgz"^ + ... + ttpz"^) (12) 

In expression (12), S and E Indicate values obtained when Z transform Is applied to and e^ In expression (11), 
respectively. 

[0124] From expressions (9) and (10), e^ can be expressed as follows: 

45 e„=8„-8„' (13) 

and is called a remainder signal between the actual sample value s^ and the linearly predicted value s„\ 
[0125] Therefore, from expression (1 2). when the linear prediction coefficients op are used as the tap coefficients of 
the MR filter and the remainder signal e„ Is used as the input signal of the IIR filter, the audio signal s„ can be obtained. 
[0126] As described above, the audio synthesis filter 74 uses the linear prediction coefficients ocp' sent from the vector 
quantization section 73 as tap coenidents, and the remainder signal e sent from the calculator 82 as an Input signal 
to calculate expression (12) to obtain an audio signal (synthesized audio signal) ss. 

[0127] The audio synthesis filter 74 uses not the linear prediction coefficients op obtained as a result of LPC analysis 
executed by the LPC analysis section 72 but the linear prediction coefficients op* serving as the code vector corre- 
^ spending to the code obtained as a result of the vector quantization of the linear prediction coefficients «p. a synthes bed 
audio signal output from the audio synthesis filter 74 is basically not the same as the audio signal obtained before the 
LPQ analysis. 
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[0128] The synmeslzed audio signal ss output from the audio synthdsls Tlltdr 72 Is sent to the calculator 71 . The 
calculator 71 subtracts the original audio signal s from the synth^lzed audio signal ss sent from the audio synthesis 
filter 74 (subtracts from each sample of the synthesized audio signal ss the sample of the original audio signal s cor 
responding to the sample of the synthesized audio signal), and sends the remainder to a square-en'or calculation 

5 section 75. The square-emorcaiculatlon section 75 calculates the square sum of the remainders sent from thecalculator 
71 (for example, a square sum in units of frames to which the LPC analysis section 72 applies LPC analysis), and 
sends a square en^or obtained as a result to a minimum-square-error detemilnation section 76. 
[01291 The mlnlmum-square-error detennlnatton section 78 stores a L code (l^code) serving as a code indicating 
a lag, a G code (Opcode) sending as a code indlcattng a gain, and an i code (Lcode) serving as a code Indicating a 

10 code word (excitation code book) In association with square errors output from the square-«n^r calculation section 76, 
and outputs the L code, the G code, and the L code associated with the square error output from the square-error 
calculation section 75. The L code Is sent to an adaptlve-code-bqok storage section 77, the G code Is sent to a gain 
decoder 78. and I code is sent to an excttadon-code-book storage section 79. In additron, the L code, the G code, and 
the I code are also sent to the code detennination section. 

f* [0130] The adapth^e-code-book storage section 77 stores an adaptive code book In whteh, for example, seven-bit L 
codes and predatennlned delay time (lags) are associated with, delays the remainder signal e sent from the cabuiator 

82 by the delay time corresponding to the L code sent from the minlmum-squane-error determination section 78, and 
outputs to a calculator BO. 

[0131] Since the adaptive-code-book storage section 77 delays the remainder signal e by the time corresponding to 
the L code and outputs It, the output signal Is similar to a periodic signal having the delay time as the period. The signal 
mainly senses as a driving signalfor generating a voiced synthesis sound In sound synthesis which uses llnearpnedlctlon 
coefficients. 

[0132] The gain decoder 78 stores a table in which G codes and predetermined gains p and y are associated wfth, 
and outputs the gains p and r associated wtOi the G code sent from the minimum^quare-error determlnaOon section 
S5 76. The gains p and y are sent to the cabulators 80 and 81 , respectively. The gain p Is called a iong-temrt fitter-state 
output gain, the gain y Is called an excitation code book gain. 

[0133] The excitadon-code-l:>ook storage section 79 stores an excitation code book in which, for example, nine-bit I 
codes and predatennlned excitation signals are associated with, and outputs the excitation signal associated with the 
1 code sent from the minimum-square-error doterminatlon section 76 to the calculator 81 . 

so [0134] Excitation signals stored in the excitation code book are, for example, similar to white noise, and mainly serve 
as drivlngsignais for generatingunvoicod synthesis sounds In soundsynthesls which uses linear prediction coefficients. 
[0135] The cakmlator 60 mult|>iies the output signal of the adaptive-code-fc>ook storage section 77 by the gain p 
output from the gain decoder 78, and sends a product 1 to the cateulator 82. The calculator 61 multiplies the ouiput 
signal of the excHatlon-code-book storage section 79 by the gain y output from the gain decoder 78, and sends a 

^ product n to the caJculator 82. The calculator 82 adds the product 1 sent from the calculator 80 to the product n sent 
from the calculator 81 , and sends the sum to the audio synthesis filter 74 and to the adaptive-code-book storage section 
77 as a remainder signal e. 

[0136] in the audk) synthesis litter 74. the remainder signal 3 sent from the calculator 82 as described atx>ve Is filtered 
by the IIR filter having the linear prediction coemclents aP' sent from the vector quantization section 73 as tap coeffl- 
^0 dents, and a synthesized audio signal obtained as a result is sent to the calculator 71 . The same processing as de- 
scribed above is performed In the calculator 71 and the square-en'or calculation eectton 76, and a square error obtained 
as a result is sent to the mlnlmum-square-en*or determination section 76. 

[0137] The minrnunrvsquare-error determination section 76 determines whether a squcve errorsent f rem the square- 
error cak»iiatlon section 75 becomes the minimum (minimal). When the minimum-squara-error detemnlnatlon section 
^ 78 detemnines that the square error Is not the minimum. It outputs the L code, the G code, and the L code conresponding 
to the square error as described above. Then, the same processing Is repeated. 

[0138] In contrast, when the minimum-square-error determination section 76 detemilnes that the square error be- 
comes the minimum, It outputs a decision signal to the code detennination section 83. The code detemninatton section 

83 latches an A code sent from the vector quantization section 73. and sequentially latches an L code, G code, and 
so an I code sent from the mlnlmum-square-error detennlnadon section 76. When the code detennination section 83 

recces a decision signal from the mlnlmunvsquare-en^or determination section 76, it sends the A code, me L code, 
the G code, and tfie I code being latched to tiie channel encoder 84. The channel encoder 84 multiplexes the A code, 
the L code, ttie G code, and the I code sent from the code determinatton sectkin 83, and sends a code data obtained 
as a result of multiplexing as encoded data. 
ss [0139] To simplify a description, it Is assumed that an A code, an L code, a G cods, and an I cods are obtained in 
each frame, it is also possible, for example, that one hBme is divided Into four sub-frames, and an L code, a G code, 
and an I code are obtained In each sub-frame. 

[01 40] In Rg . 8 (also In Fig. 9, described later), [k] is added to each variable to make It to an array variable. This "k" 
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indicates the number of frames. The description of "k' wtil be omitted appropriately In me specitlcadon. 
[0141] Fig. 9 shows an example structure of the decoding section 21 shown In Fig. 2, used when the encoder 1 
shown In Fig. 1 Is configured as shown In Rg. 8. As described above, when the decoding section 21 shown In Fig. 2 
Is configured as shown In Rg. 9» the decoding section 23 shown In Rg. 2 and the decoding sections 54 end 66 shown 

5 In Rg. 6 are also configured as shown In Fig. 9. 

[0142] The code data, serving as encoded data, output from the encoder 1 shown In Fig. 8 Is received by a channel 
decoder 91 . The channel decoder 91 separates the L code, the G code» the 1 code, and the A code from the code data, 
and sends them to an adapttve-code-booK storage section 92. a gain decoder 93. an excltatlon-code-booK storage 
section 94, and a filter-coefficient decoder 95, respectively. 

io [0143] The adaptive-code-book storage section 92» the gain decoder 93, the excitation-code-book storage section 
94, and cabulators 96 to 98 are configured In the same way as the adaptlve-code>book storage section 77, the gain 
decoder 78, the excltatlon-code-book storage sectton 78, and calculators 80 to 82. The same processing as that de- 
scribed by referring to Rg. 8 is perfcnned, so that the L code, the G code, and the I code are decoded to generate the 
remainder signal e. The remainder signal 3 Is sent to an audio synthesis filter 99 as an Input signal, and also sent to 

w the adaptive-code-book storage section 92 . 

[0144] The filter-coefficient decoder 95 stores the same code book as that stored in the vector quantization section 
73 shown In Fig. 8, decodes the A code to generate linear prediction coefTtolents op', and sends to the audio synthesis 
filter 99. 

[0145] The audio synthesis filter 99 is configured In the same way as the audio synthesis filter 74 shown in Rg. 8, 
^ The audio synthesis fitter 99 uses the linear predkrtlon coefficients op' sent from the f llier-coeff k^lent decoder 95 as tap 
coefTtolents, and the remainder signal e sent from the calculator 96 as an Input signal to calculate expression (12) to 
obtain the synthesized audio signal obtained when the minlmum-equare-enor detennination section 76 determines 
that the square error Is minimum. The synthesized audio signal Is output as the decoding result (decoded data) of the 
encoded data. 

25 [0146] An additional-information output section 1 00 acquires infonmation obtained In a process of decoding the en^ 
coded data to generate the synthesized audio signal serving as decoded data, as described ak>ove. and outputs a part 
or the whole of the tnfomnetlon as additional Information. 

[0147] iVIore specifically, the additional- Info miati on output section 1 00 receh/es the L code, the G code, the I code, 
and the A code output from the channel decoder 91 , the gains p and y output from the gain decoder 93, the linear 

30 prediction coefficients oP output from the niter-coefriclent decoder 95, the calculation result 1 output from the calculator 
96. the cabuIaUon result y output from the calculator 97, and the remainder signal e output from the calculator 98. and 
others, and outputs a part or the whole of these pieces of infomnatlon as additional Infomiatlon. 
[0148] Next, Fig. 10 shows an example structure of the encoder 1 shown In Fig. 1 used when the data transfer system 
shown in Rg. 1 encodes stili-plcture image data by a JPEG method and transfers It. When the encoder 1 shown In Fig. 

35 1 Is configured as shown in Rg. 10, the encoding section 22 shown in Rg. 2 and the encoding sections 52 and 55 
shown In Fig. 6 are also configured In the same way as shown In Rg. 10. 

[0149] Image data to be erK:oded is input to a blocking circuit 111 . The blocking circuit 111 divides the image data 
Input thereto into blocks each fomned of 64 pixels, eight by eight pixels. Each block obtained by the blocking circuit 111 
Is sent to a DCT circuit 112. The DCT circuit 112 applies DCT (discrete cosine transform) processing to each block 

^0 sent from the blocking circuit 1 1 1 to transf omn to a total of 64 DCT coefficients, one DC (di rect cun^nt) component and 
63 frequency components (AC (alternating cun'ent) components) In a horizontal direction and a vertical direction. 64 
DCT coefficients in each block are sent from the DCT circuit 112 to the quantization circuit 113. 
[0150] The quantization circuit 113 quantizes the DCT coefficients sent from the DCT circuit 112 according to a 
predetemfiined quantization table, and sends the results (hereinafter called quantized DCTcoements. If necessary) 

^ of quantization to an entropy encoding circuit 11 4 together with the quantization table sued for quantization. 

[0151] The quantization table used In the quantization circuit 113 generally has quantization steps such that DCT 
coefflclentB having low frequencies, which are highly Important, are quantized finely and.DCT coefftelents having high 
frequencies, whbh are towly important, are quantized coareely with human visual characterl^lcs being taken Into ac- 
count. Therefore, the deterioration of image quality Is suppressed, and highly efficient compression is performed. 

so [0152] In JPEG encoding, a quantization table to be used Is detennlned. for example, according to a compression 
rate specified by the user. 

[0153] The entropy encoding circuit 114 applies entropy encoding processing, such as Huffman encoding to the 
quantized OCT coefficients sent from the quantization drcult.l 1 3, adds the quantization table sent from the quantization 
circuit 113, and outputs encoded data obtained as a result 
55 [0154] Next. Rg. 11 shows an example structure of the decoding section 21 shown in Fig. 2 used when the encoder 
1 shown in Rg. 1 is configured as shown in Fig. 10. When the decoding section 21 shown in Rg. 2 are configured as 
shown in Fig. 11 . the decoding section 23 shown in Fig. 2 and the decoding section 54 and 56 shown In Rg. 6 are also 
configured In the same way as shown in Fig. 11 . 



15 



EP1 355 428A1 



[0155] The encoded data Is Input to an entropy decoding circuit 121 . The entropy decoding circuit 1 21 separates the 
encoded data Into the quantized DOT coefficients entropy-encoded and the quantization table. In addition, the entropy 
decoding circuit 1 21 applies entropy decoding to the quantized DCT coefficients entropy-encoded, and sends quantized 
DCT coefficients obtained as a result to a dequantlzation circuit 1 22 together with the quantization table. The dequan- 

s tbatlon circuit 122 dequantizes the quantized DCT coefficients sent from the entropy decoding circuit 1 21 according 
to the quantization table also sent from the entropy decoding circuit 121. and sends DCT coefficients obtained as a 
result to an Inverse DCTclrcult 1 23. The Inverse DCT circuit 1 23 applies Inverse DCT processing to the DCT coefficients 
sent from the dequantlzation circuit 12, and sends a decoded block of elght-by-elght pixels obtained as a result to a 
block separation circuit 1 24. The block separation circuit 1 24 unblocks the decoded block sent from the Inverse DCT 

10 circuit 1 23 to obtain and output decoded Image data. 

[0156] An addltional-lnfonnatlon output section 125 acquires Infomnatlon obtained In a process of decoding the en- 
coded data to generate the decoded Image data, as described above, and outputs a part orthe whole of the Infonnatlon 
as additional information. 

[0157] More speclfteally. the addltlonaHnfonnatlon output section 125 receives the quantization table and the quan- 
tbed DCT coefficients outputfrom the entropy decoding circuit 121 , the DCT coefficients outputfrom the dequantlzation 
circuit 122, and others, and outputs a part or the whole of these pieces of information as additional Information. 
[0158] Next, Fig. 1 2 shows an example structure of the encoder 1 shown in Rg. 1 usedwhen the data transfer system 
shown In Fig. 1 encodes motlon-pkturB Image data by the MPEG2 method and transfers It. When the encoder 1 shown 
in Rg. 1 is conHgured as shown in Fig. 12;the encoding section 22 shown in Rg. 2 and the encoding sections 52 and 
55 shown In Fig. 8 are also configured In the same way as shown in Fig. 12. 

[0159] A frame [or fields) constituting a motion picture to be MPEG-encoded are sequentially sent to a motion de- 
tection circuit 131 and to a calculator 132. 

[0160] The motion detection circuit 131 detects a motion vector In units macro-blocks for the frame Input thereto, 
and sends ft to an entropy encoding circuit 136 and to a motion compensation circuit 140. 

[0161] When an I Ontra) picture Is Input to the cak^uiator 132. the cateulator 132 sends it as is to a blocking circuit 
1 33. and when a P (predictive) or B (bidlrectionaily predictive) picture is input to the calculator 1 32. the calculator 132 
calculates the difference between the picture and a reference Image sent from the motion compensation circuit 140, 
and sends the difference to tiie blocking circuit 133. 

[0162] The blocking circuit 133 blocks the output of tiie calculator 132 Into pixel blocks each having elght-by-elght 
50 pixels, and send them to a DCT circuit 134. The DCT circuit 134 applies DCT processing to the pixel btocks sentfrom 
the blocking circuit 1 33. and sends DCT coefficiants obtained as a result to a quantization circuit 1 35. The quantization 
circuit 1 35 quantizes the DCT coefficients sent from the DCT circuit 1 33 in units of blocks according to a predetemnlned 
quantization table, and sends quantized DCT coemclents obtained as a result to the entropy encoding circuit 136 
together with the used quantization table. The entropy encoding cfrcult 136 applies entropy encoding to the quantized 
sff DCT coefflclentB sent from ttie quantization circuit 1 35, adds the motion vector sent from the motion detection circuit 
1 31 , the quantization table sentfrom the quantization circuit 135, and other necessary litfoimadon (such as Infonnation 
serving as the header of an MPEG stream In each layer), and outputs encoded data oblBlned as a result as an MPEG- 
encoded result. 

[0163] Among the quantized DCT coetfkHenls output from tiie quantization circuit 135, those for an 1 picture and a 
^ P picture are sent to the entropy encoding circuit 136 and to a dequantlzation circuit 137 because an I picture and a 
P picture need to be locally decoded so as to be used as reference images for a P picture and a B picture to be encoded 
later. The quantization table used in the quantization circuit 135 is also sent to the dequantlzation circuit 137. 
[01 64] The dequantlzation circuit 1 37 dequantizes the quantized DCT ooefficiBntB sent from the quantization circuit 
1 35 according to tiie quantization table sent from the quanttzatton circuit 1 35 to generate DCT coemclents. and sends 
^ them to an inverse DCTclrcult 1 38. The inverse DCTclrcult 138 applies Inverse DCT processing to the DCTcoefftolents 
sent from the dequantlzation circuit 137, and sends to a calculator 139. in addition to the output of the Inverse DCT 
circuit 138, a reference Image outputfrom the motion compensation circuit 140 is also sent to the catoulator 13d. When 
the output of the Inverse DCT circuit 1 38 Is for a P picture, the calculator 1 39 adds tiie output to tiie output of 1h e motion 
compensation ctncurt 1 40 to generate the original image, and sends to the motk>n compensation circuit 1 40. When the 
so output of the Inverse DCT circuit 138 Is for an I picture, since the output is an decoded image of an 1 picture, the 
cateulator 1 39 sends It as is to the motion compensation circuit 1 40. 

[0165] The motion compensation circuit 1 40 appHes motion compensation based on the motion vector sent from the 
motion detection circuit 131 to the locally decoded image sent from the calculator 139, and sends an image obtained 
after the motion compensation to tiie calculators 132 and 139 as a reference Image. 
ss [01 66] Next, Fig. 1 3 shows an example structure of the decoding section 21 shown in Rg. 2 used when the enoodcH' 
1 shown in Rg. 1 1s configured as shown In Fig. 12. Wh«i the decoding section 21 is configured as shown in Rg. 13, 
the decoding section 23 shown In Fig. 2 and tiie decoding sections 54 and 56 shown in Fig. 6 are also configured In 
the same way as shown In Fig. 13. 
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[0167] The encoded data Is sent to an entropy decoding circuit 1 51 . The entropy decoding circuit 151 applies entropy 
decoding to the encoded data to obtain quantized DOT coetricients, and separates a motion vecton a quantization 
table, other necessary Information from the encoded data. The quantized DCT coefficients and the quantization table 
are sent to a dequantlzation circuit 162, and the motion vector Is sent to a motion compensation cincuit 166. 

5 [0168] The dequantizatlon clm^ult 152 dequantizes the quantized DCT coefficients sent from the entropy decoding 
circuit 151 according to the quantization table also sent from the entropy decoding dncult 11 to obtain DCT coefficients, 
and sends them to an Inverse DCT circuit 153. The Inverse DCT circuit 153 applies Inverse DCT processing to the 
DCT coefficients sent from the dequantlzation circuit 152, and outputs to a calculator 154. The calculator 1 54 receives 
an I picture or a P picture which has been already decoded, to which motion compensation Is applied according to the 

10 nnotion vector sent from the entropy decoding circuit 1 51 and which Is output from the motion compensation clrx^uit 166 
as a reference Image. In addition to the output of the dequantlzation clrx^tt 163. When the output of the Inverse DCT 
circuit 153 Is fora P picture or a B picture, the calculator 1 54 adds the output to the output of the motion compensation 
circuit 156 to generate the original Image by decoding, and sends to a block separation circuit 155. When the output 
of the inverse DCT circuit 153 Is for an I picture, since the output is an decoded Image of the I picture, the calculator 

13 1 54 sends It as is to the blocic separation section 155. . 

[0169] The block separation circuit 166 unblocl^ the decoded image sent from the cabulator 164 In units of pixel 
blocks to obtain decoded Image data, end outputs it. 

[0170] The motion compensation circuit 155 receives the I picture and the P picture among the decoded images 
output from the calculator 154, and applies motion compensatk>n based on the motion vector sent from the entropy 
2o decoding circuit 151 . Then, the moQon compensation circuit 156 sends an image obtained after the motion compen- 
sation to the calculator 154 as a reference Image. 

[0171] An addltional-infomiatlon output section 157 acquires infomnant obtained in a process of decoding the en- 
coded data to generate decoded Image data, as described above, and outputs a part or tiie whole of the information 
as additional Infomnatlon. 

ss [0172] More specifically, the additional- information output section 157 receives the quantization table, the quantized 
DCT coetTicients, and the motion vector output from the entropy decoding circuit 151 , and the DCT coefficients output 
from the dequantlzation circuit 122. in addition, the addttlonai-lnfomiatlon output section 1 57 also receives Information 
(such as a picture type, block positional Information, a frame DCT mode/a field DCT mode) disposed in each layer of 
an IVIPEG stream obtained when the entropy decoding circuit 161 applies entropy decoding to the encoded data. The 

30 additional-Information output section 157 outputs a part or the whole of these pieces of Infonrtatton as additional infor- 
mation. 

[0173] Next, the above-described series ot processlngcan be Implemented not only by hardware but also by software. 
When the series of processing is achieved by software, a program constituting the software Is installed Into a general- 
purpose computer or others. 

^ [01 74] Fig. 1 4 shows an example stnjcture of a computer Into wliich a program executing the above-described series 
of processing is Installed, according to an embodiment 

[0175] The program can be recorded in advance into a hard disk 205 or a ROM 203 serving as a recording medium 
which is built in the computer. . 

[0176] Aitematlvely, the program can be stored (recorded) temporarily or perpetually In removable recording media 
40 211 , such as a floppy disk, a CD-ROM (compact disc read-only memory), a DVD (digital versatile disk), a magnetic 
disk, and a eemtconductor memory. Such removable recording media 21 1 can be provided as so-called package soft- 
ware. 

[0177] The program can be installed Into the conputer from removable recording media 21 1 such as those described 
above. In addition, the program can be transferred by radio from a downloading site to the computer through an artificial 
49 sateatte for digital satellite broadcasting, or to the computer by wire through a network such as the Internet; and the 
computer can receive the program transfenred In such a way by a communication section 208, and Install into the hard 
disk 206, built in the computer. 

[0178] The computer Includes a CPU (central processing unit) 202. The CPU 202 Is connected to an input and output 
Interface 210 through a bus 201. When the user operates an Input section 207 formed of a keytx)ard. a mouse, a 

so microphone, and others to input a conrvnand through the Input and output Interface 210. the CPU 202 executes a 
program stored In the ROM (read-only memory) 203. Alternatively, the CPU 202 loads Into a RAM (random access 
memory) 204 aprogram stored In the hard disk 205; a program transfen*ed through the satellite orthe network, received 
by the communication section 208. and installed into the hard disk 205; or a program read from a removable recording 
medium 211 mounted to a drive 209, and installed Into the hard disk 205; end executes It. With this operation, the CPU 

55 202 perfonns processing based on the above-described flowchart, or processing executed by the structure shown in 
the above-described block diagram. Then, for example, the CPU 202 outputs the processing result through the input 
and output Interface 210 to a display section 208 formed of an LCD (liquid-crystal display), a speaker, and others; 
transmits from the communication section 208; or records In the hard disk 205, as required. 
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[0179] In the piBsent specification, the processing steps describing the programs Tor executing various types ot 
processing are not necessarily processed In a time sequential manner In the order In which the steps are described In 
the flowcharts. Processing to be executed In parallel or Individually (such as parallel processing or processing by 
objects) is also included. 

s [0180] Further, the programs may be processed by one computer or by a plurality of conrputere In a distributed- 
processing manner. In addition, the pnogranns may be transferred to and executed by a remote computer 
[0181 ] The present Invention can be applied without using a specific encoding/decoding method. IVIore specfficatly: 
In the present embodiment, the CELP method, the JPEG method, and the MPEG2 method have been described. The 
present Invention can also be applied to various types of encodlng/decoding methods, such as tiie M-JPEG (motion 

10 JPEG) method, the I^PEGI method, the M PEG4 method, the MP3 (MPEG-1 Audio Uyer 3) method, and the ATRAC 
(adaptive transtomn acoustic coding) method. 

[0182] In the present embocflment, encoded data Is decoded by a decoding method conresponding to the encoding 
method. The encoded data can be decoded by class-dassincation adaptive processing. In ciass-classlficatlon adaptive 
processing, the encoded data can be decoded by using tap coemdents obtained by performing learning In which data 
13 to be encoded Is set to master data and encoded data obtained by encoding the data Is set to apprentice data. 

[0183] Further, In the present embodiment, a prediction value for high-quallty data Is obtained by the linear prediction 
calculation using the tap coefficients. The prediction value can also be obtained by a higher-order, second-order or 
more, prediction calculation. 

[0184] Further, in the present emtx}diment. the class-classification adaptive processing dncuit 24 in the decoder 2 
2o stores In advance tap coefficients used tor improving quality. The tap coefficients can be Included In encoded data and 
provided for the decoder 2. 

[0185] Furthermore, in the present embodiment, a prediction tap is generated from the first additional Information 
and the second additional infomriatlon In addition to the first decoded data and the second decoded data. The prediction 
tap can also be generated, for example, only fk-om the ffrst decoded data and the second decoded data. The same 
ss Eipplias to a class tap. 

Industrial Applicability 

[0186] According to the Hrst data processing apparatus, the first data processing method, the first program, and the 

30 first recording medium accorxllng to the present Invention, encoded data Is decoded, and decoded data obtained as a 
result is encoded to output re-encoded data. A prediction tap used for a predetermined prediction calculation with tap 
coemclents obtained by learning is generated from the decoded data and intonnatlon obtained from the re-encoded 
data. The predlcUon tap and the tap coefficients are used to pert omi the predetenmined prediction calculation to obtain 
a prediction value comeaponding to master data used as a master In the learning. TTierefore, for sample, data having 

^ sufficiently improved quality can be obtained. 

[0187] According to the second data processing apparatus, the seconddata processlngmethod, thesecond program, 
and the second recording medium according to the present invention, decoded data obtained by encoding master data 
and decoding It. and Infomiatlon obtained from re-encoded data obtained by encoding the decoded data are generated 
from the master data serving as a master, as apprentice data serving as an apprentice. Then, a prediction tap used 

40 for predtcling the master data Is generated from the apprentice data, and learning is periomied such that the prediction 
error of a prediction value for the master data, obtained by performing a predetennined prediction calculation by using 
the prediction tap and tap coefncients to obtain the tap coefficients. Therefore, for example, data having sufficiently 
improved quality can be obtained by performing a prediction caicuiation with the use of the tap coefficients. 
[0188] According to the third data processing apparatus, the third data processing method, the third program, and 

^ the third recording medium according to the present invention, encoded data obtained by encoding data Is decoded, 
and decoded data obtained as a result Is encoded to output re-encoded data. Then, a dass tap used for dass classi- 
fication is generated from the decoded data and Infomnation obtained from the ra-encoded data. Oass classification 
Is performed according to the dass tap. Therefore, data can be appropriately dasslfied Into classes. 

so 

Claims 

1 . A data processing apparatus for processing encoded data obtained by encoding data, characterfased by compris- 
ing: 

ss 

decoding means for decoding the encoded data and for outputting decoded datc^ 

re-encodlng means for encoding the decoded data and for outputdng re-encoded data; 

predlctlon-tap generation means forgeneradng a prediction tap usedfora predetermined prediction calculation 
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With tap coefficients obtained by learning, from the decoded data and Informadon obtained from the re-encoded 
data; 

tap-c9,efflclent acquisition n^eans for acquiring the tap coefficients; end 

prediction means for obtaining a prediction value corresponding to master data used as a master In the learn- 
ing, by the predetennlned prediction calculation with the use of the prediction tap and the tap coefficients. 

2. A data processing apparatus according to Claim 1 . characterized in that 
the prediction means obtains the prediction value by a linear prediction calculation with the use of the pre- 
diction tap and the tap coefficients. 

3. A data processing apparatus according to Claim 1 , characterized In that 
the decoding means outputs information obtained In a process of decoding the encoded data, as additional 

Information, and 

the predictlon^ap generation means generates the prediction tap by also using the additional infomiatlon. 

4. A data processing apparatus according to Claim 1. characterized by further comprising re-decoding means for 
decoding the re-encoded data and for outputting re-decoded data» and characterized In that 

the prediction-tap generation means generates the prediction tap from the decoded data and the re-decoded 

data. 

5. A data processing apparatus according to Claim 4, characterized In that 

the re-decoding means outputs Information obtained in a process of decoding the re-encoded data, as ad- 
ditional infomnatlon, and 

the predlctlon-tap generation means generates the prediction tap by also using the addltlonaJ Infomnatlon. 

25 

6. A data processing apparatus according to Claim 1 , characterized by further comprising: 

class-tap generation means for generating a class tap used for class classification for classifying Information, 
from the decoded data and infomiatlon obtained from the re-encoded data; and 
so class classification means for perfonnlng class classification according to the class tap. and characterized 

in that 

the tap-coeflldent acquisition means, acquires the tap ooeniclents conresponding to a class output from the 
class classification means, and . . 

the prediction means obtains the prediction value by using the tap coefficients corresponding to the class 
ss output from the class classification means. 

7. A data processing apparatus according to Claim 6. characterized In that 

the decoding means outputs Infonnation obtained In a process of decoding the encoded data, as additional 
Information, end 

40 the class-tap generation means generates the class tap by also using the additional Information. 

8. A data processing apparatus according to Claim 6, characterized by further comprising re-decoding means for 
decoding the re-encoded data and for outputting re-decoded data» and characterized In that 

the class-tap generation means generates the class tap from the decoded data and the re-decoded data. 

45 

9. A data processing apparatus according to Claim 8, characterized In that 

the re-decoding means outputs Information obtained in a process of decoding the re-encoded data, as ad- 
ditional infomiatlon. and 

the class-tap generation means generates the class tap by also using the additional infomnation. 

so 

10. A data processing apparatus according to Claim 1 . characterized In that 

the data Is Image data. 

11 . A data processing apparatus according to Claim 1 0, characterized In that 

ss the encoded data includes data obtained by at least orthogonally transfonning the image data. 

12. A data processing apparatus according to Claim 1 , characterized In that 

the data Is audio data. 
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13. A data-processing apparatus according to Claim 12. characterized In that 

the encoded data Includes at least a code conresponding to linear prediction coefficients and to a remainder 
signal. 



14. A data processing methodfor processing encoded data obtained by encoding data, characterized by comprising: 

a decoding step of decoding the encoded data and of outputtlng decoded data; 

a re-encodIng step of encoding the decoded data and of outputtlng re-encoded data; 

a predlctlon-tap generation step of generating a prediction tap used for a predetermined prediction calculation 

with tap coefficients obtained by teaming, from the decoded data and Infoimatlon obtained from the re-encoded 

data; 

a tap-coefftcfent acquisition step of acquiring the tap coeffldenls; and 

a prediction step of obtaining a prediction value corresponding to master data used as a master In the learning, 
by the predetemnlned prediction calculation with the use of the prediction tap and the tap coefficients. 

1 5. A program f ormaking a computer process encoded data obtained by encoding data, characterized by comprising: 

a decoding step of decoding the encoded data and of outputtlng decoded data; 

a re-encoding step of encoding the decoded data and of outputting re-encoded data; 

a predlctlon-tap generation step of generating a prediction tap used for a predetermined prediction calculation 

with tap coefflcfents obtained by teaming, from the decoded data and Information obtained from the re-encoded 

data; 

a tap-coefficient acquisition step of acquiring the tap coefficients; and 

a prediction step of obtaining a prediction value comesponding to master data used as a master In the learning, 
by the predetermined prediction calculation with the use of the prediction tap and the tap coalficients. 

1 6. A recordin g medium storing a program which malces a computer process encoded data obtain ed by encoding data, 
characterized by recording the program comprising: 

a decoding step of decoding the encoded data and of outputtlng decoded data; 

a re-encoding step of encoding the decoded data and of outputting re-encoded data; 

a predlctlon-tap generation step of generating a prediction tap used for a predetermined predlcUon calculation 

with tap coefficients obtained by learning, from the decoded dataand information obtained from the re-encoded 

data; 

a tap-coefficient acquisition step of acquiring the tap coeffldenls; and 

a prediction step of obtaining a predlcdon value coniesponding to master data used as a master In the learning, 
by the predetermined prediction calcuiation with the use of the prediction tap and the tap coafFidants. 

17. A data processing apparatus for learning predetenmined tap co^lclents used for processing encoded data ob- 
tained by encoding data, characterized by connprising: 

apprentbe-data generation means for gerieradng from master data serving as a master, decoded data obtained 
tiy encoding the master data and then decoding it. and infonnalion obtained from re-encoded data obtained 

encoding the decoded data, as apprentice data serving as an apprentice; 
predlctton-tap generation means for generating a prediction tap used for predicting the master data, rrom the 
apprentice data; and 

learning means for performing learning such that the prsdictlon error of a prediction value for the nraster data, 
obtained by performing a predetermined prediction caiculatlon by using the predlcdon tap and tap coeffidents, 
is statistically minimum, and for obtaining the tap coefFictents. 

18. A data processing apparatus according to Claim 1 7, characterized In that 

the leaming means performs learning such that the prediction error of a prediction value for the master data, 
obtained by a linear prediction caiculatlon by using the prediction tap and the tap coeffidents, is statistically min- 
imum. 



19. A data processing apparatus according to Claim 1 7. characterized in that 

the apprentice-data generation means outputs also information obtained In a process of decoding encoded 
data obtained by encoding the master data, as the apprentice data. 
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20. A data processing apparatus according to Claim 1 7. characterized In that 

the apprentice-data generation means outputs re-decoded data obtained as a result when the re-encoded 
data Is decoded, as the apprentice data. 

21 . A data processing apparatus according to Claim 20, characterized In that 

the apprentice-data generation means outputs also Infomnatlon obtained In a process of decoding the re- 
encoded data, as the apprentice data. 

22. A data processing apparatus according to Claim 1 7, characterized by further comprising: 

class-tap generation means for generating a class tap used for performing class classification which classifies 
infomiation. from the apprentice data; and 

class classification means for performing dass dassincation according to the class tap, and characterized 
In that 

the learning means obtains the tap coefficients for each class output from the class classification means. 

23. A data processing apparatus according to Claim 22, characterized In that 

the apprentice-data generation means outputs also infomnatlon obtained In a process of decoding encoded 
data obtained by encoding the master data, as the apprentice data. 

24. A data processing apparatus according to Claim 22, characterized In that 

the apprentice-data generation means outputs re-decoded data obtained as a result when the re-encoded 
data Is decoded, as the apprentice data. 

25. A data processing apparatus according to Claim 24, characterized In that 

the apprentice-data generation means outputs also Information obtained In a process of decoding the re- 
encoded data, as the apprentice data. 

26. A data processing apparatus according to Claim 1 7, characterized In that 

the master data Is Innage data. 

27. A data processing apparatus according to Claim 26. characterized In that 

the apprentice-data generation means encodes the Image data at least by orthogonal transfonn. 

28. A data processing apparatus according to Claim 1 7, characterized In that 

the data Is audio data. 

29. A data processing apparatus according to Claim 28. characterized in that 

the apprentice-data generation means encodes the audio data to generate at least a code corresponding to 
linear prediction coefficients and to a remainder signal. 

30. A data processing method for learning predetemnlned tap coefficients used for processing encoded data obtained 
by encoding data, characterized by comprising: 

an apprentice-data generation step of generating from master data serving as a master, decoded data obtained 
by encoding the master data and then decoding It, and Infomiatlon obtained from re-encoded data obtained 
by encoding the decoded data, as apprentice data serving as an apprentice; 

a prediction-tap generation step of generating a prediction tap used for predicting the master data, from the 
apprentbe data; and 

a learning step of perfonning learning such that the prediction en'or oT a prediction value for the master data, 
obtained by a predetemnlned prediction calculation by using the prediction tap and tap coefficients, is statis- 
tically minimum, and of obtaining the tap coefficients. 

31 . A program for making a computer execute data processing for learning predetennined tap coefficients used for 
processing encoded data obtained by encoding data, characterized by comprising: 

an apprentice-data generation step of generating from master data serving as amaster, decoded data obtained 
by encoding the master data and then decoding It. and Infomnatlon obtained from re-encoded data obtained 
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by encoding the decoded data, as apprentice data serving as an apprentice: 

a predlctlon-tap generation step of generating a prediction tap used for predicting the master data, from the 
apprentice data; and 

a learning step of perfonnlng learning such that the prediction en^r of a prediction value for the master data, 
obtained by a predetemilned prediction calculation by using the prediction tap and tap coeff idents, is statis- 
tically nrtlnlmum. and of obtaining the tap coefficients. 

32. A recording medium storing a program which makes a computer execute data processing for learning predeter- 
mined tap coenicients used for processing encoded data obtained by encoding data, characterized by recording 
the program comprising: 

an apprentlce-datageneradon step ofgeneratlngfrom master data serving as amaster, decoded data obtained 
by encoding the master data and then decoding It. and Information obtained from re-encoded data obtained 
by encodbig the decoded data, as apprentice data serving as an apprentice; 

a prediction-tap generation step of generating a prediction tap used for predicting the master data, from the 
apprentice data; and 

a learning step of perlonnlng learning such that the prediction en^or of a prediction value for the master data, 
obtained by a predetemilned prediction calculation by using the prediction tap and tap coefficients, is statls- 
ticaily minimum, and of obtain^glhetapcoeffia'ents. 

33. A data processing apparatus for perfomiing dass dassiflcatlon which classifies infomiatlon, characterized by 
connprising: 

decoding means for decoding encoded data obtained by encoding data and for outputting decoded data; 
re-encoding means for encoding the decoded data and for outputdng re-encoded data; 
class-tap generation means for generating a class tap used for the dass dassiflcatlon. from the decoded data 
and Information obtained from the re-encoded data; and 

claaa dassiflcatlon means lor perfomning class dassiflcatlon according to the dass tap. 

34. A data processing apparatus according to Claim 33, characterized in that 

the decoding means outputs information obtained in a process of decoding the encoded data, as additional 
Information, and 

the dass-tap generation means generates the dass tap by also using the addlUonai infomfiatlon. 

35. A data pnocaseing apparatus according to Claim 33, characterized by further comprising re-decoding means for 
decoding the re-encoded data and for outputting re-decoded data» and characterized In that 

the dass-tap generation means generates the class tap from the decoded data and the re-decoded data. 

39. A data processing apparatus according to Claim 35. characterized In that 

the re-decodIng means outputs Infonnatlon obtained In a process of decoding the re-encoded data, as ad- 
ditional Information, and 

the prediction-tap generation means generates the prediction tap by also using the additional Infonnatlon. 

37. A data processing apparatus according to Claim 33. characlerlzed In that 

the data is image data. 

38. A data proceedng apparatus according to Claim 37, eharaelarlzed in that 

the encoded data Indudes data obtained by at least orthogonally transfomrifng the image data. 

39. A data processing apparatus according to Claim 33. characterized in that 

the data Is audio data. 

40. A data processing apparatus according to Claim 30, characterized in that 

the encoded data Indudes at least a code corresponding to linear prediction ooeff Idents and to a remainder 
signal. 

41 . A data processing method for perfomiing dass ciasstflcatlon which dassifles Infbmnatlon. characterized by com- 
|3 rising: 
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a decoding step of decoding encoded data obtained by encoding data and for outputting decoded data: 
a re-encodIng step of encoding the decoded data and for outputdng re-encoded data; 
a class-tap generation step of generating a class tap used for the class classification, from the decoded data 
and Information obtained from the re-encoded data; and 
5 a class classification step of performing class classification according to the class tap. 

42. A program Tor making a computer execute data processing for performing class classification which classifies 
Information, characterized by comprtelng: 

io a decoding step of decoding encoded data obtained by encoding data and for outputting decoded data; 

a re-encodIng step of encoding the decoded data and for outputting re-encoded data; 
aclass-tap generation step of generating a class tap used for the class classification, from the decoded data 
and Infonnation obtained from the re-encoded data; and 

a class classification step of performing class classification according to the class tap. 

rs 

43. A recording medium storing a program which makes a computer execute data processing for performing clase 
dasslflcalbn which classiflee Information, characterized fay recording the program comprising: 

a decoding step of decoding encoded data obtained by encoding data and for outputting decoded data; 
20 a re-encodIng step of encoding the decoded data and for outputdng re-encoded data; 

a class-tap generation step of generating a o\ass tap used for the class ciassiftcation, from the decoded data 
and infonnation obtained from the ra-encoded data; and 

a class dassificetton step of performing class classification according to the class tap. 
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